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11  ABSTRACT  lAmoismawaMF  ~  “ 

A  nonlinear  joint  transform  image  correlator  is  investigated.  The  Fourier  transform 
interference  intensity  is  thresholded  to  provide  higher  correlation  peak  intensity 
and  better  defined  correlation  spot.  Analytical  expressions  for  the  thresholded 
Joint  power  spectrum  is  provided.  The  effects  of  the  nonlinearity  at  the  Fourier 
plane  on  the  correlation  signals  at  the  output  plane  is  investigated.  The  correla¬ 
tion  signals  are  determined  in  terms  of  the  nonlinear  characteristics  of  the  spatial 
light  modulator  (SLM)  at  the  Fourier  plane.  We  show  that  thresholding  the  inter¬ 
ference  intensity  results  in  a  sum  of  infinite  harmonic  terms.  Each  harmonic  term 
is  envelope  modulated  due  to  the  nonlinear  characteristics  of  the  device,  and  phase 
modulated  by  m  times  the  phase  modulation  of  the  nonthresholded  joint  power  spectrum. 
The  correct  phase  information  about  the  correlation  signal  is  recovered  for  the  first 
order  harmonic  of  the  thresholded  Interference  intensity.  We  show  that  various  types 
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1.  Introduction 


We  have  investigated  an  optical  system  where  the  correlation  between  the  images 
can  be  performed  by  nonlinear  correlation  which  has  substantially  superior  performance 
compared  to  that  of  the  classical  optical  correlator.  This  optical  processor  is  joint  Fourier 
transform  correlator  (JTC)  based  system1  which  allows  both  the  input  scene  and  the 
reference  objects  to  be  updated  in  real  time.  The  nonlinear  image  correlator  uses 
nonlinearity  at  the  Fourier  plane  to  threshold  the  Fourier  transform  interference  intensity. 
The  performance  of  the  nonlinear  optical  correlator  has  been  compared  to  that  of  the 
classical  optical  correlator  in  the  areas  of  light  efficiency,9'12  correlation  peak  to  sidelobe 
ratio,  autocorrelation  width,  and  cross-correlation  sensitivity.  It  is  shown  that  compared 
with  the  classical  correlator,  ;he  bipolar  joint  transform  correlator  provides  significantly 
higher  peak  intensity,  larger  peak  to  sidelobe  ratio,  narrower  autocorrelation  width,  and 
better  cross-correlation  sensitivity.  Since  the  autocorrelation  functions  have  small  width, 
larger  reference  images  can  be  used,  and  the  restriction  on  the  locations  of  the  images  and 
their  autocorrelation  width,  which  exists  for  the  classical  joint  transform  correlator,  is 
eliminated. 

2.  Joint  Transform  Correlation 

In  joint  transform  correlation,1  the  interference  pattern  intensity  of  the  two  signals 
located  at  the  input  plane  is  recorded.  When  the  recorded  intensity  pattern  is  read  out  by 
a  collimated  beam,  the  correlation  between  the  two  signals  can  be  obtained  by  taking  the 
inverse  Fourier  transform  of  the  recorded  intensity  pattern. 

The  reference  pattern  and  the  input  pattern  displayed  on  the  monitor  are  imaged 
onto  the  spatial  light  modulator.  The  purpose  of  this  spatial  light  modulator  is  to  convert 
the  incoherently  diffused  image  of  the  monitor  to  a  coherent  image  at  the  output  of  the 

device.  For  this  reason,  LCLV  is  called  an  image-to-image  converter. 
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The  coherent  outpu*  image  of  the  LCLV1  contains  the  input  and  the  reference 
patterns  displayed  side  by  side.  The  Fourier  transforms  of  the  two  patterns  are  obtained 
by  the  transform  lens.  The  second  spatial  light  modulator  (LCLV2)  is  located  at  the 
Fourier  plane  of  the  transform  lens.  Thus,  the  input  to  LCLV2  is  the  interference  between 
the  Fourier  transforms  of  the  reference  and  the  signal  patterns. 

The  output  image  of  the  device  is  proportional  to  the  intensity  of  the  write-in 
signal.  Therefore,  the  intensity  of  the  interference  between  the  Fourier  transforms  of  two 
inputs  is  obtained  at  the  device  output.  The  inverse  Fourier  transform  of  the  recorded 
intensity  pattern  is  obtained  by  a  second  transform  lens.  The  correlation  between  the  two 
codes  id  displayed  at  the  focal  plane  of  the  lens.  The  correlation  intensity  is  detected  by 
the  detector  array  located  at  the  output  plane  of  the  processor. 

The  operation  of  the  joint  transform  correlator  can  be  understood  by  considering  a 
simple  mathematical  analysis  of  the  system.  The  coherent  output  image  of  LCLVl 
contains  the  reference  and  input  patterns  displayed  side  by  side.  The  Fourier  transforms  of 
the  two  signals  are  taken  by  the  transform  lens.  The  second  spatial  light  modulator 
(LCLV2)  is  located  at  the  lens  Fourier  plane.  Thus,  the  input  to  LCLV2  is: 

fj(a,/7)  =  F{g(x,y)}  exp(-ijf- aa)  +  F{r(x,y)}  exp(+jf  oa)  (1) 

where  g(x,y)  is  the  output  image  function  of  the  input  signal,  and  r(x,y)  is  the  output 
image  function  of  the  reference  signal,  a  is  the  distance  of  the  signals  from  the  optical 
axis,  A  is  the  wavelength  of  the  illuminating  light,  f  is  the  focal  length,  and  a  is  the 
spatial  frequency  coordinate. 

The  output  image  function  of  the  signal  s(x,y)  imaged  onto  the  LCLV  is: 

g(x,y)  =  Kl  [s,(x,y)]s  exp[i  k2log  (iiM))], 

o 


(2) 


where  Kj ,  and  K2  are  constants,  I0  is  a  threshold  value  of  illumination,  and  S  is  the 
slope  of  the  intensity  response  curve. 

A  second  LCLV  (LCLV2)  is  used  to  record  the  intensity  of  the  interference  between 
the  two  Fourier  transforms.  Thus,  the  read-out  light  leaving  LCLV2  becomes: 

F2  (<*,/?)=  F{g(x,y)}  exp(-  |foa)  +  F{r(x,y)}  exp  (+i|foa)  2  (3) 

After  some  straightforward  calculations,  we  have: 

F 2(«,/?)  =  F{g(x,y)}  2  +  | F{r(x,y)} | 2  +  F{g(x,y)}  F*{r(x,y)}  exp(-  ^y-a2a) 

+F*{g(x,y)}  F{r(x,y)}  exp(+  a2a)  (4) 

By  taking  the  inverse  of  the  Fourier  transform  intensity,  the  output  light 
distribution  will  contain  the  correlation  between  the  input  signal  and  the  reference  signal; 
i.e., 

=  gi(x'y)  *  +  r(x',y')  *  r(x',y') 

+r(x'  -  2a, y')  *  g'(x',y')  +  r(x'  +  2a, y')  *  glx'j'),  (5) 

where  *  denotes  correlation.  Thus,  the  light  distribution  at  the  output  plane  contains  the 
correlation  between  the  signals  r(x,y)  and  g(x,y)  displayed  at  (2a, 0)  and  (~2a,0).  The 
auto-correlations  of  r(x,y)  and  g(x,y)  are  displayed  at  the  origin  (0,0). 


3.  Nonlinear  Optical  Correlation 

The  nonlinear  joint  transform  image  correlator1'8  can  either  use  a  Charge-Coupled 
Device  (CCD)  interfaced  with  a  Spatial  Light  Modulator  (SLM)  or  a  high  contrast 
optically  addressed  SLM  at  the  Fourier  plane.  In  the  former  case,  the  interference  between 
the  Fourier  transforms  of  the  reference  and  the  input  signals  is  produced  by  a  Fourier 
transform  lens,  and  the  intensity  distribution  of  the  Fourier  transform  interference  is 
obtained  by  a  CCD  array  located  at  the  fourier  plane.  The  CCD  array  is  connected  to  a 
thresholding  network  interfaced  with  a  binary  SLM,  also  at  the  Fourier  plane,  that  reads 
out  the  binarized  joint  power  spectrum  in  real  time.  A  second  transform  lens  is  used  to 
obtain  the  inverse  Fourier  transform  of  the  threshoided  interference  intensity  pattern, 
which  can  yield  the  desired  correlation  results.  A  high  contrast  optically  addressed  SLM 
can  also  be  used  at  the  Fourier  plane  to  obtain  the  Fourier  transform  interference  intensity 
and  then  threshold  the  interference  intensity  according  to  the  nonlinear  characteristics  of 
the  device. 

In  this  section,  we  provide  a  mathematical  analysis  of  the  nonlinear  joint  transform 
image  correlator.  The  effects  of  nonlinearity  at  the  Fourier  plane  on  the  correlation  signals 
at  the  output  plane  will  be  investigated.  The  correlation  signals  will  be  determined  in 
terms  of  the  nonlinear  characteristics  of  the  SLM  at  the  Fourier  plane.  We  investigate  the 
effects  of  various  types  of  nonlinear  devices  such  as  the  kth  law  nonlinearity  and  the  hard 
clipping  nonlinearity  on  the  correlation  signals.  Analytical  expressions  for  the  threshoided 
joint  power  spectrum  will  be  determined.  The  analysis  provided  here  may  be  sued  to  study 
the  effects  of  any  arbitrary  type  of  nonlinearity  on  the  correlation  signals.  We  show  that 
the  threshoided  interference  intensity  can  be  considered  as  a  sum  of  infinite  harmonic 
terms.  Each  harmonic  term  is  envelope  modulated  due  to  the  nonlinear  characteristics  of 
the  device,  and  phase  modulated  by  m  times  the  phase  modulation  of  the  nonthresholded 
joint  power  spectrum,  where  m  is  an  integer.  Thus,  the  correct  phase  information  c?n  be 


recovered  for  the  first  order  harmonic  term.  The  higher  order  correlation  signals  can  be 
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removed  by  spatial  filtering  at  the  output  plane.  Various  types  of  correlation  signals  such 
as  the  phase-only  correlation  signal  can  be  produced  by  selecting  the  appropriate 
nonlinearity.  Thus,  the  need  to  synthesize  a  specific  matched  filter  to  produce  a  specific 
correlation  signal  is  eliminated.  Computer  simulations  of  the  correlator  are  used  to  study 
the  performance  of  the  system  and  the  results  will  be  compared  with  those  of  the  classical 
joint  transform  image  correlator.  We  show  that  the  nonlinear  correlator  can  provide  a 
much  higher  autocorrelation  peak  intensity,  smaller  autocorrelation  sidelobes,  narrower 
correlation  width,  and  better  discrimination  sensitivity. 

3.1  Analysis 

In  this  section,  we  provide  a  mathematical  expression  for  the  correlation  functions 
at  the  output  plane  of  the  nonlinear  optical  correlator.  The  thresholded  interference 
intensity  can  be  determined  using  the  transform  method  of  communication  theory  for  the 
analysis  of  nonlinear  devices. 

The  implementation  of  the  nonlinear  correlator  using  both  high  contrast  optically 

addressed  SLM  and  binary  electrically  addressed  SLM  is  shown  in  Figure  1(a)  and  (b), 

respectively.  Plane  Pj  is  the  input  plane  that  contains  the  reference  signal  and  the  input 

signal  displayed  on  SLMj .  the  incoherent  images  enter  the  input  SLM  and  are  converted 

to  coherent  images.  The  images  are  then  Fourier  transformed  by  lens  FTLt  and  the 

interference  between  the  Fourier  transforms  is  produced  at  plane  P2.  In  Figure  1(a),  the 

nonlinear  joint  transform  image  correlator  is  implemented  using  a  high  contrast  optically 

addressed  SLM  at  the  Fourier  plane.  The  Fourier  transforms  interference  is  displayed  at 

the  input  of  a  high  contrast  optically  addressed  SLM  to  obtain  the  intensity  of  the  Fourier 

transform  interference.  The  high  contrast  optically  addressed  SLM  can  also  threshold  the 

joint  power  spectrum  according  to  the  nonlinear  characteristics  of  the  device.  The 

thresholded  interference  intensity  is  read  out  from  the  output  of  SLM2  by  coherent  light. 

The  correlation  signals  can  be  produced  at  the  output  plane  by  taking  the  inverse  Fourier 
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transform  of  the  thresholded  interference  intensity  distribution  provided  at  the  output  of 
SLM2.  In  Figure  1(b),  an  electrically  addressed  SLM  is  used  to  implement  the  nonlinear 
correlator.  The  intensity  of  the  Fourier  transform  interference  is  obtained  by  a  CCD  array 
located  at  plane  P2  and  is  thresholded  using  a  thresholding  network.  A  SLM  located  at 
plane  P3  is  used  to  read  out  the  binarized  intensity  of  the  Fourier  transform  interference 
provided  by  the  thresholding  network.  The  correlation  functions  can  be  produced  at  plane 
P4  by  taking  the  inverse  Fourier  transform  of  the  binarized  interference  intensity 
distribution  at  plane  P3. 

The  reference  and  input  signals  located  at  plane  Pj  are  denoted  by  r(x+x0,y)  and 
s(x-xQ,y),  respectively.  The  light  distribution  at  the  back  focal  plane  of  the  transform  lens 
FTLj  is  the  interference  between  the  Fourier  transforms  of  the  two  output  image 
functions;  i.e. 

I (or,jS)  =  s( a,P)  exp  [iy?s(a,/?)]  exp  (-i  x0a)  + 

R  (a,/?)  exp  [i(^(ma,bO]  exp  (i  x0a),  (6) 

where  ( a,0 )  are  the  angular  spatial  frequency  coordinates,  and  S (a,P)  exp  [i <^s(o,/?)]  and 
R(ar,/?)  exp  [i<pR(ar,/J)j  correspond  to  the  Fourier  transforms  of  the  input  signals  s(x,y)  and 
r(x,y),  respectively.  Here,  R(ar,/?)  and  S(a ,/?)  are  the  amplitude  spectrum  and  <pK{a,0) 
and  ips(a,P)  are  the  phases  of  the  Fourier  transforms.  The  Fourier  transform  interference 
intensity  distribution  at  plane  P2  can  be  written  as: 

E  (a,0)  =  |I(a,/J)|2  =  +  R2(a,/>)  + 

S(a,/?)  exp  [i^s(a,/?)j  R(a,0)  exp  [-i(^R(a,/?)  exp  (-i  2x0a)  + 

S(aJ)  exp[-iv?s(a,/?)]  R(a,/J)  exp  [i ipK(aJ)  exp  (i  2x0a)  (7) 
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In  the  classical  case,  the  inverse  Fourier  transform  of  Equation  (2)  can  produce  the 


correlation  signals  at  the  output  plane: 

h(x\y')  =  Rn(x',y')  +  RJ2(x,,y/)  + 

R^x'^y')  +  R2l(x'+2x„y'),  (8) 

where 


R^tx'.y')  =  R12(x',y')  =  // s(«)  r({-x',<-y')d<dC,  (9) 

R,  jCx'.y')  =  // s({,0  s(5-x',C-y')d?dC,and  (10) 

R22(x',y')  =  // r({,0  r(«-x',C-y')d«dC,  (11) 

Here,  the  Fourier  transform  interference  intensity  provided  by  the  CCD  array  is 
thresholded  before  the  inverse  Fourier  transform  operation  is  applied.  The  CCD  array  at 
the  Fourier  plane  is  connected  to  a  binary  SLM  through  a  thresholding  network  so  that  the 
thresholded  interference  intensity  distribution  can  be  read  out  by  coherent  light. 

The  thresholded  joint  power  spectrum  can  be  considered  as  the  output  of  a 
nonlinear  system  as  shown  in  Figure  2.  The  nonlinear  characteristics  of  the  thresholding 
network  is  denoted  by  g(E)  where  E  is  the  Fourier  transforms  interference  intensity.  An 
expression  for  the  thresholded  interference  intensity  can  be  obtained  by  a  similar  approach 
as  the  analysis  of  nonlinear  systems  using  the  transform  method  of  communication  theory. 
Let  the  Fourier  transform  of  the  nonlinear  characteristic  of  the  thresholding  network  be 
defined  by: 
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00 

GM  =  /  g(E)  exp  (-i  u  E)dE 
-00 


(12) 


Tbe  output  of  the  nonlinear  system  is  given  by  the  inverse  Fourier  transform 
relationship,  i.e., 


g(E)  G(o/)  exp  (i^E)do;. 

”00 


(13) 


The  thresholded  interfsrence  intensity  distribution  can  be  obtained  by  substituting 
in  Equation  (5)  for  E(o,/7)  given  by  (2): 


g(E)  =^r /“  G(u,)  exp  (iw  [R2(a,/?)  +  S2(a,/J)| 
-00 


exp  {i2u;  R(a,/?)  S(a,/?)  cos[2x0a  +  <ps{a,p)  -  c/>R(a,/?)]do;  (14) 


The  second  exponential  factor  can  be  expanded  using  the  Jacobian— Anger  formula: 


exp  {i2u>  R (a,/?)  S (a,/?)  cos[2x0a  -  </?R(a,/?)  +  </>s(a,/?)|  = 


00 


E  ev(i)vJj2w  R{a,0)  S(a,/?)|  cos[2vx0a  +  v<ps(a,p)  -  vip^(a,0)}  (15) 

v=0 


where  6V  =  -I 


1,  v=0 


2,  v>0 

output  of  the  nonlinear  system  is  given  by: 


,  and  Jv  is  a  Bessel  function  of  the  first  kind,  order  v.  Thus,  the 


(16) 
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g(E)  =  S  7F(‘)V  /  exp  (ia;  [R2(a’^)  + 

v=(J  LJ  J 

S2(a,/?)]}  JJ2 u  R(a,0)S(a,0)]  cos[2vx0a  +  vys(a,0)  -  vpR(a,/?)]du>  (17) 

The  output  of  the  thresholding  network  can  be  written  as: 

g(E)  =  £  H  [R(a,/3),S(a,0)]  cos[2vx0a  +  v<pS{a,0)  -  vpR(  <*,/?)]  (18) 

v=0 

where 


Hv  [R(o,/J),S(a,/3(]  =  ^-(i)v  /  G(U)  exp  {iu,  [R’(a,/3)  + 

S  W)l)  JJ2W  R(a,/?)S(o,/?)ldw.  ( 19) 

It  can  be  seen  from  Equation  (19)  that  for  v=l,  the  nonlinear  system  has  preserved 
the  phase  of  the  cross-correlation  term  [</?s(a,/?)  -  ^(or,/?)]  and  only  the  amplitude  is 
affected.  This  explains  the  good  correlation  properties  of  the  first  order  correlation  signal 
at  the  output  plane.  The  higher  order  terms  in  the  series  expansion  [Equation  22]  can  be 
removed  by  spatial  filtering  at  the  output  plane,  although,  the  intensity  of  the  higher  order 
terms  is  relatively  small  compared  with  that  of  the  first  order  correlation  signal. 

To  investigate  the  effects  of  nonlinearity  on  the  correlation  signal,  we  consider  two 
types  of  nonlinearity:  the  hard  limiter  and  a  general  type  kth  law  device.  The  transfer 
characteristics  of  the  limiter  is  shown  in  Figure  2.  In  the  transform  method  of  analysis,  we 
consider  the  thresholding  effects  of  the  interference  intensity  on  the  terms  corresponding  to 
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the  cross— correlation  signals  only.  Thus,  it  is  assumed  that  the  unmodulated  terms  of 
Equation  (15)  have  been  subtracted  from  the  joint  power  spectrum. 

The  Fourier  transform  of  the  full  wave  (odd)  kth  law  device  is  given  by: 

gm  =  -2-  r(k+2),  k  <  1,  (20) 

where  r(-)  is  the  Gamma  function,  and  K  is  the  severity  of  the  nonlinearity.  K  =  1 
corresponds  to  a  linear  device  and  K=0  corresponds  to  a  hard  clipping  nonlinearity. 
Substituting  the  Fourier  transform  of  the  nonlinearity  in  Equation  19,  we  have: 

Hv  (R(a,/J),S(a,/))]  =  r(k+l)  ^-(ifk''  /  [2WR(a,/J)s(a,/!)]dw  (21) 


Thus,  cau  be  written  as: 


Hv[R(a,ffl,S(a,«) 


nr(k+l)(v[2R(o,«S(a,^)]k 
2  2k''r(i-^r(i+ 


(22) 


where  T(t)  is  the  Gamma  function. 

The  output  of  the  nonlinearity  using  Equation  (13)  is  given  by: 


gk(E)  =  5 

v=l 

(v  odd) 


<vr(k+l)(R(a,/3)S(o,/J))k 

2Kr(1_  u-k)r(1+  u+k^  cosi2v*°a  +  (23) 

2  2 


It  can  be  seen  from  this  equation  that  each  harmonic  term  is  phase  modulated  by  v 
times  the  phase  difference  of  the  input  signal  and  the  reference  signal  Fourier  transforms, 
and  the  higher  order  correlation  signals  are  diffracted  to  2vx0.  The  envelope  of  each 
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harmonic  term  is  proportional  to  the  kth  power  of  the  product  of  the  Fourier  transform 
magnitudes  of  the  input  signal  and  the  reference  signal.  If  the  phase  of  the  input  signal  and 
the  reference  signal  are  the  same,  then  the  threshoided  output  will  produce  an  output 
correlation  signal  corresponding  to  the  inverse  Fourier  transform  of  the  kth  power  of  the 
2R(a,/?)S(or,B).  Furthermore,  for  k=l  the  output  will  produce  the  linear  correlation 
between  the  reference  signal  and  the  input  signal. 

The  correct  phase  information  of  the  joint  power  spectrum  is  obtained  for  the  first 
order  harmonic  term  (v=l)  which  yields: 

S,t(E)  -  2r(k'*'i2^R( |g?^k  COsl2x»“  +  (24) 

r( l-  r(i+ 

If  the  input  signal  and  the  reference  signal  are  the  same,  then  Equation  (24)  will  produce 
the  threshoided  joint  power  spectrum  for  autocorrelation  signals;  i.e., 

8.  i(E)  =  -V,  1  l+k,  lR(«-/»)n  “M  <25> 

i  (1-  -if-  1  (1+  -jr~) 

It  can  be  seen  from  Equation  (25)  that  for  k=jj  the  threshoided  interference 
intensity  will  produce  an  autocorrelation  signal  that  is  identical  to  the  autocorrelation 
signal  obtained  by  a  phase-only  matched  filter.  Thus,  a  phase-only  autocorrelation  signal 
is  produced  without  synthesizing  a  phase-only  matched  filter.  Furthermore,  various  types 
of  correlation  signals  can  be  produced  simply  by  varying  the  degree  of  nonlinearity  and 
without  the  need  to  synthesize  the  specific  matched  filter. 

The  effects  of  a  hard  clipped  nonlinearity  is  determined  by  setting  k=0  in 
Equation  (25): 
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(26) 


«o(E)  =  E 


v=i  r(i-  J)r(i+  £ 

(v  odd)  L  1 


cos [2vx0a+  v <ps(  a,/7)  -  vy?R(a,/?))]. 


It  can  be  seen  from  this  equation  that  the  amplitude  modulation  is  entirely  removed 
by  the  hard  clipping  operation.  The  correct  phase  of  the  joint  power  spectrum  is  obtained 
by  the  first  order  intermodulation  term  for  v=l  which  can  be  written  as: 


gto(E)  =  7CQs[2xQa  +  *>s(a,j3)  -  ^(»,/3)]. 


(27) 


If  the  Fourier  phase  of  the  input  signal  and  the  reference  signal  is  the  same,  the 
output  of  the  first  order  component  is: 

gio(£)  ^  7c°s(2x0a)  (28) 


Thus,  the  first  order  autocorrelation  signal  at  the  output  plane  is  an  impulse 
o 

function  with  amplitude  —  located  at  2x0. 

If  a  magneto-optic  device  (MOD)  is  used  at  the  Fourier  plane  to  read  out  the 
binarized  interference  intensity,  then  the  transmittance  function  of  the  device  will  be  the 
product  of  the  thresholded  interference  intensity  and  the  2-D  grating  function  of  the  device 
pixel  structure.  In  this  case,  the  light  distribution  at  the  output  plane  consists  of  the 
replicated  correlation  signals  due  to  the  sampling  effects  of  the  2— D  grating  structure  of  the 
MOD.  The  intensity  of  the  (m,n)th  order  spectra  is  weighted  by  sine2  ^j-sinc2 
where  a  is  the  pixel  size,  d  is  the  period  of  the  D— D  grating  structure  of  the  device,  and 
is  the  duty  cycle  of  the  grating.  The  intensities  of  the  higher  order  spectra  drop  rapidly 
due  to  the  large  duty  cycle  of  the  device. 


3.2  Computer  Simulation  Result 


A  numerical  analysis  of  the  nonlinear  optical  correlator  is  provided  to  study  the 
thresholding  effects  of  the  transforms  interference  intensity  on  the  correlation  signals.  To 
study  the  performance  of  the  proposed  system,  we  have  used  a  128*128  point  2-D  fast 
Fourier  transform  (FFT)  and  the  results  are  plotted  using  a  3-D  plotting  subroutine.  The 
correlation  tests  are  performed  for  the  aerial  image  of  a  building.  The  first  order 
autocorrelation  term  of  the  binary  JTC  for  two  input  signals  was  produced.  The  Fourier 
spectrum  R  (at,0)  was  evaluated  and  the  threshold  value  VT  of  the  interference  intensity 
was  determined.  The  Fourier  component  gla(a,/l)  that  generates  the  first  order 
autocorrelation  signal  was  obtained.  An  inverse  fast  Fourier  transform  subroutine  was 
used  to  obtain  the  first  order  autocorrelation  signal. 

In  reference  8,  we  presented  a  computer  simulation  analysis  of  the  nonlinear 
correlator  to  obtain  the  light  distribution  at  the  output  of  the  processor  by  numerical 
techniques.  In  that  numerical  technique,  the  joint  power  spectrum  was  binarized  to  +1 
and  0  according  to  a  predetermined  threshold  value.  An  inverse  FFT  was  then  applied  to 
obtain  the  correlation  signals.  Here,  we  have  compared  the  first  order  autocorrelation  term 
obtained  by  the  Fourier  series  expansion  technique  and  the  first  order  autocorrelation  term 
obtained  by  the  numerical  technique  described  in  reference  8.  The  autocorrelation 
experiments  are  performed  for  characters  F  and  F  used  as  the  input  signals  and  the 
cross-correlation  experiments  are  performed  for  the  characters  F  and  L  used  as  the 
input  signals.  Table  I  illustrates  the  correlation  results  obtained  by  the  Fourier  series 
expansion  technique.  The  results  are  compared  to  the  correlation  signals  produced  by  the 
numerical  technique  which  is  obtained  by  taking  the  inverse  FFT  of  the  binarized  Fourier 
transforms  interference  intensity  (see  reference  8).  In  this  table,  Rq  is  the  autocorrelation 

peak  intensity,  Rq/S.L.  is  the  ratio  of  the  autocorrelation  peak  intensity  to  the  maximum 
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Table  I.  Comparison  between  the  nonlinear  correlation  results  obtained  by  the 
Fourier  series  expansion  technique  and  the  results  obtained  by  the 
numerical  technique. 


R2 

0 

r2/sl2 

FWHM 

(x'-y') 

r2/r2 

o'  c 

Correlation  results 
obtained  by 
binarizing  the  joint 
power  spectrum 

1. 

11.5 

(1-1) 

14.2 

Correlation  results 
obtained  by  the 

Fourier  series 
expansion  techniques 

1.13 

8.82 

(1-1) 

11.94 

2  2 
*Rq  is  the  normalized  first  order  autocorrelation  peak  intensity,  SL  is  the  largest 

sidelobe  intensity,  and  FWHM2  is  the  full  correlation  width  at  the  half  maximum. 

R2  is  the  maximum  cross-correlation  intensity. 

sidelobe  intensity,  and  FWHM  is  the  full  correlation  width  at  half  maximum.  The 
correlation  intensities  are  normalized  by  the  peak  intensity  of  the  results  obtained  by  the 
numerical  technique.  Rc  is  the  maximum  cross-correlation  intensity. 

The  results  indicate  (See  Table  I)  that  the  correlation  signals  obtained  by  these 
methods  are  almost  equivalent  and  have  the  same  autocorrelation  width,  13%  difference  in 
the  auto-correlation  peak  intensity,  and  7%  difference  in  the  autocorrelation  peak  to 
sidelobe  ratio,  and  15%  difference  in  the  ratio  of  autocorrelation  peak  to  the  maximum 
cross-correlation  intensity.  Thus,  the  Fourier  series  expansion  technique  represents  a 
reasonable  accurate  description  of  the  first  order  Fourier  component. 

We  have  also  investigated  the  thresholding  effects  of  a  kth  law  nonlinearity  on  the 
Fourier  transforms  interference  intensity.  This  case  corresponds  to  using  a  nonlinearity  at 


the  Fourier  plane  that  has  an  input/output  characteristics  of  a  kth  law  device.  Equation 
(24)  is  used  to  generate  the  correlation  signals  for  various  degrees  of  nonlinearity.  The 
correlation  results  obtained  by  binarized  joint  power  spectrum10  corresponds  to  using  a 
hard  clipping  nonlinearity  width  k=0. 

Figure  3(a)  illustrates  the  modified  Fourier  transforms  interference  intensity  where 
only  the  modulated  terms  are  retained.  The  thresholded  interference  intensity  distribution 
when  a  kth  law  nonlinearity  is  used  is  shown  in  Figures  3(b)  —  (d).  The  nonlinearities 
correspond  to  k=0.9,  0.7,  and  0.5  as  shown  in  the  figure.  It  can  be  seen  from  this  figure 
that  as  the  severity  of  nonlinearity  increases  the  pixel  values  of  the  higher  spatial 
frequencies  of  the  interference  intensity  values  of  the  higher  spatial  frequencies  of  the 
interference  intensity  increase.  For  a  hard  clipping  nonlinearity,  the  amplitude  modulation 
is  entirely  removed  and  only  the  phase  information  is  retained. 

The  correlation  signals  for  the  input  aerial  image  are  shown  in  Figure  4.  Figure  4(a) 
shows  the  correlation  results  when  the  interference  intensity  is  not  thresholded  (k=l),  and 
figure  (b),  (c),  and  (d)  show  the  correlation  results  when  the  interference  intensity  is 
thresholded  according  to  Equation  (24)  for  k=0.9,  0.7,  and  0.5.  It  is  evident  from  this 
figure  that  the  correlation  signals  corresponding  to  the  thresholded  interference  intensity 
have  higher  peak  intensities,  higher  peak  to  sidelobe  ratios,  and  narrower  correlation 
widths. 

Table  II  illustrates  the  results  of  the  tests  for  the  linear  and  nonlinear  correlation. 

ty  0  0 

In  this  table,  Rq  is  the  autocorrelation  peak  intensity,  Rq/S.L.  is  the  ratio  of  the 

autocorrelation  peak  intensity  to  the  maximum  sidelobe  intensity,  and  FWHM  is  the  full 
correlation  width  at  half  maximum.  FWHM  is  determined  by  evaluating  the  points  where 
the  correlation  intensity  drops  to  one-half  of  its  peak  value.  K  is  the  degree  of  the 
nonlinearity  for  the  kth  law  device  given  by  Equation  (20). 
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Table  II.  Correlation  results* 


Correlator 

k 

R2 

0 

r2/s.l.2 

O' 

FWHM 

Linear  Correlator 

1 

1 

1.25 

(35-41) 

Nonlinear  Correlator 

0.9 

1.86 

1.53 

(23-23) 

Nonlinear  Correlator 

0.8 

4.48 

2.2 

(5-7) 

Nonlinear  Correlator 

0.7 

15.3 

4.14 

(3-3) 

Nonlinear  Correlator 

0.6 

77.5 

9.5 

(1-1) 

Nonlinear  Correlator 

0.5 

559. 

12.7 

(1-1) 

2  2 
*Rq  is  the  first  order  autocorrelation  peak  intensity.  S.L.  is  the  largest  sidelobe 

intensity,  k  is  the  degree  of  nonlinearity.  FWHM  is  the  full  correlation  width  at 

the  half  maximum. 


It  can  be  seen  from  this  table  that  thresholding  the  interference  intensity  has 
significantly  increased  the  autocorrelation  peak  intensity  compared  to  the  classical  case. 
The  linear  correlator  has  a  correlation  peak  intensity  of  unity,  whereas  the  nonlinear 
correlator  has  a  peak  value  of  1.86,  15.3,  and  559  for  k=0.9,  0.7,  and  0.5,  respectively. 
Consequently,  if  we  have  a  correlator  set  up  with  a  given  laser  source,  using  the  nonlinear 
technique  for  k=0.5,  an  increase  of  559  in  the  detector  output  voltage  can  be  expected. 
Thresholding  the  interference  intensity  has  also  reduced  the  correlation  sidelobes 
considerably  for  the  nonlinear  case.  The  linear  correlator  has  a  peak  intensity  to  sidelobe 
intensity  ratio  of  1.25,  whereas  the  nonlinear  correlator  has  a  peak  to  sidelobe  ratio  of  1.5, 
4.1,  and  12.7  for  k=0.9,  0.7,  and  0.5,  respectively. 

It  is  evident  from  Table  II  that  thresholding  the  interference  intensity  has  resulted 
in  a  significant  reduction  in  the  autocorrelation  width  and  has  produced  impulse  like 
autocorrelation  functions  for  small  k.  The  linear  correlator  has  width  of  35x41  pixels  in  the 
x'-y'  direction,  whereas  the  nonlinear  correlator  has  a  width  of  1*1  pixels  in  the  x'-y' 
direction  for  k=0.5. 
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We  made  some  attempts  to  reduce  the  correlation  width  of  the  classical  joint 
Fourier  transform  correlator  by  edge  enhancement  of  the  input  signals.  This  results  in  a 
correlation  width  of  12*12  pixels  in  the  x7-y7  direction,  no  significant  change  in  the  size  of 
the  sidelobes,  and  5.8  times  decrease  in  the  correlation  peak  intensity.  Thus,  the 
autocorrelation  width  obtained  by  binarization  of  the  interference  intensity  is  considerably 
better  than  the  edge  enhanced  classical  correlation  results. 

Multiple  diffracted  correlation  terms  are  produced  due  to  the  thresholding  of  the 
Fourier  transforms'  interference  intensity.  However,  the  size  of  the  higher  orders  appear 
small  when  compared  to  the  first  order  diffracted  correlation  term.  According  to  the 
computer  simulations,  the  first  order  autocorrelation  peak  intensity  is  15  times  larger  than 
the  second  order  correlation  peak  intensity  for  k=0.  Thus,  the  higher  order  correlation 
signals  are  much  smaller  than  the  first  order  correlation  signal. 

4.  Conclusion 

We  have  introduced  a  nonlinear  image  correlator  with  substantially  superior 
performance  compared  to  that  of  the  classical  optical  correlator.  This  optical  processor  is 
joint  Fourier  transform  correlator  (JTC)  based  system  which  allows  both  the  input  scene 
and  the  reference  objects  to  be  updated  in  real  time.  The  nonlinear  image  correlator  uses 
nonlinearity  at  the  Fourier  plane  to  threshold  the  Fourier  transform  interference  intensity. 
The  performance  of  the  nonlinear  optical  correlator  has  been  compared  to  that  of  the 
classical  optical  correlator  in  the  areas  of  light  efficiency,  correlation  peak  ot  sidelobe  ratio, 
autocorrelation  width,  and  cross-correlation  sensitivity.  It  was  shown  that  compared  with 
the  classical  correlator,  the  bipolar  joint  transform  correlator  provides  significantly  higher 
peak  intensity,  larger  peak  to  sidelobe  ratio,  narrower  autocorrelation  width,  and  better 
cross— correlation  sensitivity.  Since  the  autocorrelation  functions  have  small  width,  larger 
reference  images  can  be  used,  and  the  restriction  on  the  locations  of  the  images  and  their 
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autocorrelation  width,  which  exists  for  the  classical  joint  transform  correlator,  is 
eliminated. 
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High  Contract 


Figure  1  (a)  Nonlinear  optical  correlator  implementation  using  a  high  contrast 
optically  addressed  SLM  at  the  Fourier  plane. 


FTL  Fourier  Transform  Lens 
CCD  Charged-Coupled  Device 

Reference  Image  SLM  Spatial  Light  Modulator 

t(x.y-v  )  Y1  FTL  y 


Electrically 
Addressed  SLM 


24 


Figure  2.  Thresholding  network  using  a  klD  law  device  nonlinearity. 
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Figure  3  (a)  Thresholded  modified  joint  power  spectrum  using  a  kth  laws  device. 

k=l  corresponds  to  a  linear  correlation  and  the  severity  of  the 
nonlinearity  increases  as  k  decreases. 

(a)  k=l 
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Figure  3  (b)  Joint  power  spectrum  for  k=0.9 


Figure  3  (c)  Joint  power  spectrum  for  k=0.7. 
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Figure  4.  Correlation  signals  obtained  by  the  thresholded  modified  joint 

fover  spectrum  suing  a  ktB  law  device.  k=l  corresponds  to  a 
inear  correlation  and  the  severity  of  the  nonlinearity  increased 
as  k  decreases. 

(a)  k=l 
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Figure  4.(b)  Correlation  signals  for  k=0.9 
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